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1. INTRODUCTION 

The tendency for software development projects to be completed over 
schedule and over budget has been documented extensiveiy( 1, 2) 
Additionally many projects are completed within budgetary and 
schedule target only as a result of the customer agreeing to accept 

reduced functionality. _ ^ 

In his classic book. The Mythical Man Month, Fred Brooks(3) exposes 
the fallacy that effort and schedule are freely interchangeable. All 
current cost models are produced on the assumption that there is very 
limited scope for schedule compression unless there is a 
corresponding reduction in delivered functionality. 

The Metrication and Resource Modelling Aid (MERMAID) project, 
partially financed by the Commision of the European Communities 
(CEC) as Project 2046 began in October 1988 and Its goals were as 
follows: 


• Improvement of understanding of the relationships between 
software development productivity and product and process metrics 

. To facilitate the widespread technology transfer from the 
Consortium to the European Software industry 

• To facilitate the widespread uptake of cost estimation techniques 
by the provision of prototype cost estimation tools. 

MERMAID has developed a family of methods for cost estimation, 
many of which have had tools implemented in prototypes. These 
prototypes are best considered as toolkits or workbenches. Figure 1 
gives an architectural overview of these prototypes. 

The applicability of the tools developed by the MERMAID consortium 
is considered to encompass both embedded systems and management 
information systems. 
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The first prototype was demonstrated in November 1990. It was 
developed* on aSUN 3/60 Workstation using an objective oriented 
extension ot the C language, Objective C. Two vei^ions exist, one 
running under the Portable Common Tool Environment (PCTE) and the 
other is a UNIX Implementation. The second prototype was 
demonstrated In November 1991, versions of which were developed 
on an IBM PS/2 running either WINDOWS 3 or OS/2 and Presentation 
Managers first commercial version was demonstrated atthel 4 th 
International Conference on Software Engineering May, 1992. A 
third and final prototype was demonstrated at the 1992 cbPnii 
Technical Conference. 


2. MERMAID ESTIMATION METHODS 


At the time of the start of the MERMAID project, October 1988, the 
commonly used approaches to cost estimation were as follows. 

• Expert Judgement, ie informal guestimate of the resources 
required. 


. Analogy, similar to the above but influenced by the 
identification of a completed project, similar to the one being 
planned. 


• Use of a cost estimation tool based on one of a number of 
existing parametric models of the relationships between project cost 
parameters and cost drivers. Models on which tools were based 
included SLIM(4), COCOMO(5), and COPMO(6). 


Tools based on these models can be calibrated for a pai rticular 

environment. However, research has shown that despite 

the accuracy of estimates produced by cost estimation tools is poor.(7) 


There are several contributing factors to this inaccuracy. These 
include the difficulty, if not impossibility, of estimating the size of the 
product to be developed as early in the lifecycle as the Requirement 
Analysis Phase. Additionally calibration depends on the existence of 
moderate quantities of past project data collected in a consistent 


manner. 
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The MERMAID approach Is based on the use °* f aMuriM consistency 
user-defined metrics. This has the advantage «Mng consistency 
and increasina accuracy of forecasts. As Indicated above, today s tools 
based on parametric models normally require the °J a 

estimator to input an estimate of the size of the m oc? or n the 

developed. This is either expressed in Lines 5® d ®J t L 2^ n ? r , a l f 
form of a function-based metric such as Function n is 

the view of the MERMAID project that wherever possible estimates 
must be based on measures not other estimates. ^ls ls coupled with 
the development lifecycle model assumed by MERMAID, le a project is 
always regarded as a series of milestones separated by Phases.Care 
must be taken not to confuse this use of the term phase with its use in 
a particular lifecycle model. 

3. PROJECT METHODOLOGY 

The MERMAID approach was systematic in determining what research 
to undertake and how to put the results of this research into practical 

use. 

The basic steps of this process were: 

* Understand the current state of the art and the user requirements 
in the area under investigation 

* Analyse and undertake the formal research and develpoment into 
the subject area, subject to a peer review 

* Provide a proof of concept vehicle(POCV);this was either In th® 
form of a paper or an executable model.The quality level assi ocia 
with such was lower than that required for the prototype toolsets-Some 
results of this process are discussed in the following section.The 
overall results of MERMAID emphasise the benefits of carrying out 
research and development in such collaborative projects.There was a 
mixture vital to producing tools and methods of practical use t < o 
European Software Engineering and often impossible to achieve in 

one organisation. 
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4. RESEARCH ACTIVITIES. 

The project carried out an extensive programme of empirical work 
associated with the analysis of data made available t °j h ® P r °^ t0 
result of particular interest to the practitioner community was that 
function point counts are not independent.This work is reported I fu y 
in a number of Project Deliverables.(9)Addltlonally the research ^ 
included the building of a number of models and proof of concept 
vehlcies(POCV).lf we consider resource modelling, the project 
examined 2 fundamentally different approaches, systems dynamics 
coupled with soft system methodology(10)andparamettic 
modellings 1)ln the latter case a new model, KUNAMAA, was 
proposed and a POCV is currently being validated though this work is 
hampered by a lack of appropriate data. 


5. MERMAID AND ESPRIT 

The Commission of the European Communities (CSC) launched 
ESPRIT in 1983 largely as a consequence of the realisation m Europe 

that its Information Technology industry was ^ 

uncompetitive particularly viz-a-viz Japan. ESPRIT projects cover 
both hardware and software technologies and address both factory 
and office automation. Both software engineering and artificial 
intelligence are primary focuses. MERMAID is one of a number of 
projects, some current and others which have been completed, which 
address aspects of software development, management and metrics. 
Two immediate predecessors of MERMAID in which some of ideas 
were developed were IMPW(12) and REQUEST(13). The former 
developed an integrated project management toolkit which included 
support for cost estimation and latter was c .°™'®™® d . 
aspects of software reliability.A new project (P6283 ), GOAL, intends to 
develop tools for managing multi-partner distributed systems projects. 

ESPRIT has begun its third phase and today’s projects have a clearer 
user requirement orientation than those in the first phase «« owed* 
largely technology push projects. The change in emphasis followed 
early evaluations of the programme which showed a disappointing 
take-up of the research output by industry even in cases where 
industry itself was the prime mover behind the project. 
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6. THE IMMEDIATE FUTURE 

Considerable effort has been devoted to developing a risk 
assessment capability which conforms to the MERMAID philosophy. 
Such a capability will require access to a knowledge base of 
previous projects and measures of risk to project budget and 
schedule will be estimated using simitar statistical and analogies 
techniques to those used for effort estimation. This is presently 
available in a separate tool,RlskTool. A further pair of 
methods for use when there Is a shortage of data describing past 
projects are providedjthese are the Analogy-Based Estimation 
Method,suitable when there is between 4 and 10 projects and the 
Experience-Based Estimation Method for fewer than 4 projects.The 
ready availability of past and present project data is ensured by the 
use of another MERMAID developed tool,DCSS which supports the 
user in defining what they wish to collect with an extensive knowledge 
base of attributes and metrics.A commercial version of °CSS is now 
available.Whilst the exploitation plans of the partners in the MERMAID 
project are by no means clear it is likely that commercial versions of 
most if not all of the prototypes will become available during 1993. 
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Mermaid Architecture 

Estimation 
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Introduction 
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a management view point 
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‘ There are three kinds of lies: 
lies, damned lies and statistics. ’ 
Benjamin Disraeli, 1804-1881 


Estimates are often unbelievable 
Missed opportunity because risks too difficult to manage 
Unexpected risks consume the profits 
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Introduction 
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*** Structure of presentation 
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MERMAID, scope of approach 

MERMAID, the project 

Methods of estimation 
and risk assessment 

Conclusions 
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MERMAID, 
Scope of approach 


Emphasis of: 
integrated data storage 
integrated concepts 
integration within environment 
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* * * * 

*** Extent of support: *** 

tools 
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*** Extent of support: 

depth of detail 



project 

decomposition 


data definitions and records of all 

quality assurance measured and 

standards estimated data 
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Extent of support: 
integration with local environment 


Estimation base 


Project-specific definitions 



local definitions 


generic definitions 
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Scope of approach 

Extent of support: 
people 
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*** 


data collector 

estimator <^aoo c|j 

risk assessor^ 



quality 

assurance 


Estimation 



site 


expert 


project coordinator 
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MERMAID, the project 



MERMAID, the project 

A project partially funded by 
the Commission for the European Community 
as project 2046 within 

the European Strategic Programme for Research in Information Technology. 
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*** 

Facts 



Timescale 

October 1988 to October 1992 


Effort 

48 person years 


Partners 

Volmac Nederland bv 

City University 

Data Management spa 

National Computer Centre 

University College Cork 

Valtion Teknillinen Tutkimuskeskus 


(Utrecht, NL) 
(London, UK) 
(Pisa, I) 
(Manchester, UK) 
(Cork, IRL) 
(Helsinki, SF) 
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MERMAID, the project 
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*** 

Outputs 
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* * 

*** 


Research: 
improved methods 

Information dissemination 

Toolset for Windows 3 on P/C 

Version t (May 1992): initial set of features 
Version 2 (Nov 1992): demonstration at ESPRIT Technical Week 


Copyright © City University, London, 1992. 
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Methods of estimation 
and risk assessment. 
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*** Alternative methods 

of estimation 



Statistically-based estimation 




Number of projects 
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Methods of ... 
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*** Statistically-based 

estimation 



Derives a complete estimation equation 
from records of historic projects/tasks 

Only effective cost-drivers are used: 

Report of closeness of fit of equation to historic projects. 


Skilled needed for: 

selecting historic projects that are similar 
identifying exceptions 


Copyright © City University. London. 1992. 
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Methods of ... 

s o 

* * 

*** Causal similarity 
estimation method 



Identifying the historic project or task 
which is most similar 
to the current project or task. 


Skill needed for: 

selecting the project attributes to be used. 
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Methods of ... 


Case-based reasoning 
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* * 


Based on estimating the effect of the important differences 
between the current project or task and a case history. 


Skill-based approach, supported by: 
methods of quantifying this difference 
logical framework for recognising assumptions in the estimate 
ability to identify and assess external risks 
logical sequence for making an estimate 
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Methods of ... 

Risk identification 



previous cost drivers 
risk drivers from estimates 


configurable 
risk checklist 


I I 

risk drivers 



expert 

opinion 


Copyright © City University. London, 1992. 


folio 17 


Methods of ... 
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*** Risk analysis 




assess targets 
compared to 
estimates 


risk drivers 

(risk exposure = ...) 

I 

compare priority 

risk exposure to ranking of 
historic projects risk drivers 
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Methods of ... 

Progress monitoring 



Following milestones 

... monitoring of targets 

... new estimates made using newly available data 
... revision of risk assessments 


At regular intervals 

.. monitoring of risks which occur 
against expected level of risks 
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Conclusions 
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